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ABSTRACT 

This document contains brief descriptions of activities of 
the National Assessment of Educational Progress (NAEP) for the assessment 
cycle from October 1, 2001 through September 30, 2002. Data are presented 
about the numbers of student booklets processed, items administered, and 
responses scored. Information is provided about sample size at grades 4, 8, 
and 12. Information is also provided about meetings and conferences connected 
with NAEP, including meetings of the National Assessment Governing Board, and 
publications released during the assessment cycle. A list is provided of NAEP 
contractors for the assessment cycle, with a capsule description of each 
contractor’s activities. A final fact sheet provides information about the 
use of the NAEP Web site throughout the assessment cycle. (SLD) 




Reproductions supplied by EDRS are the best that can be made 
from the original document. 
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Assessment Cycle October 1, 2001 - September 30, 2002 



NAEP operations during the last assessment cycle collected a virtual 
mountain of materials — they are some of the “numbers behind the 
numbers" that appear in NAEP reports. 




READING 

Total number of student booklets processed: 332,497 



Number of discrete constructed-response items administered: 356 
Number of constructed responses scored: 4 , 214,229 

Number of additional responses scored from previous assessments (for 177 trend items); 335,197 
Total number of constructed responses scored: 4 , 549,426 



Total number of student booklets processed: 285,851 
Number of discrete constructed-response items administered: 60 
Number of constructed responses scored: 608,269 

Number of additional responses scored from previous assessments (for 118 trend items); 148,760 
Total number of constructed responses scored: 757,029 



WRITING 




TOTAL MAIN ASSESSMENT 

Total number of student booklets processed: 618,348 

Total number of discrete constructed-response items administered; 41 6 




Number of constructed responses scored: 4 , 822,498 

Number of additional responses scored from previous assessments (for 295 trend items): 483,957 
Total number of constructed responses scored: 5 , 306,455 
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NAEP 2002 

TALLY OF STUDENTS 
BY GRADE AND 
SUBJECT 



Assessment Cycle October 1, 2001 - September 30, 2002 

NAEP operations during the last assessment cycle collected a virtual 
mountain of materials — they are some of the '‘numbers behind the 
numbers" that appear in NAEP reports. 



To accurately represent the academic performance of 4,191,800 
students in 73.000 public and private schools across the nation, 
NAEP assessed grade 4 samples of: 

12.044 Students in National Writing 

31.447 Students in National Reading 

138.236 Students in State Writing 

139.481 Students in State Reading 

in 6,414 public (5.793) and private (621) schools 



To accurately represent the academic performance of 3.983.800 
students in 46,000 public and private schools across the nation, 

NAEP assessed grade 8 samples of: 

14.298 Students in National Writing 

31,081 Students in National Reading 

116.925 Students in State Writing 

113,606 Students in State Reading 

in 5,403 public (4.793) and private (605) schools 



To accurately represent the acaoemic performance of 3,238,600 
students in 31.000 public ana private schools across the nation, 

NAEP assessed grade 12 samples of: 

18.888 Students in National Writing 

25.888 Students in National Reading 

in 754 public (459) and private (295) schools 



NAEP assessed grades 4, 8, & 12 total samples of: 

45.230 Students in National Writing 

88.416 Students in National Reading 

255.161 Students in State Writing 

253.087 Students in State Reading 

641,894 Students in State and National Writing and Reading 
12.571 Participating Schools in State and National NAEP 
(11,050 public and 1.521 private) 
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NAEP 2002 



MEETINGS AND 
PUBLICATIONS 
RELEASE DATES 



Assessment Cycle October 1, 2001 - September 30, 2002 



October 



October 1, 2001 NAEP Contractors’ Meeting — Washington, DC 

October 17-19 Design and Analysis Committee (DAC) Meeting — Washington, DC 



November 



November 14-16 National Assessment Governing Board (NAGB) Meeting — Alexandria, VA 

November 20 Release of The Nation's Report Cards: Science Highlights 2000 

(NOES 2002-452) and State Science 2000 Reports (NOES 20)2-453) 
November 30 NAEP Validity Studies Panel (NVS) Meeting — Washington, DC 



December 



December 3-4 Combined NAEP State Coordinator Orientation and “Large Group” 

Training — Washington, DC 

December 9-1 1 Science Committee Meeting — Princeton, NJ 



O 

FRII 



January 



January 18, 2002 
January 22-24 
January 23 
January 29 
January 31 



Oral Reading Study Group Meeting — Washington, DC 
Education information Advisory Committee (El AC) Meeting — St. Petersburg, FL 
State Assessment Directors Meeting — Sarasota, FL 
NAEP Contractors’ Meeting — Washington, DC 

Technology Rich Environment (TRE) Advisory Group Meeting — Princeton, NJ 



February 



February 1-2 Design and Analysis Committee (DAC) Meeting — Washington, DC 

February 28-March 2 National Assessment Governing Board (NAGB) Meeting — New Orleans, LA 



March 



March 17-April 18 Reading Scoring — Virginia Beach, VA 

March 18-19 Mathematics Committee Meeting — Princeton, NJ 

March 21 NAEP Validity Studies Panel (NVS) Meeting — Washington, DC 










NAEP 2002 



MEETINGS AND 
PUBLICATIONS 
RELEASE DATES 



Assessment Cycle October 1, 2001 - September 30, 2002 



April 



April 2-19 
April 1 1 
April 16-17 
April 22-July 25 



Mathematics Scoring — Mesa, AZ 
NAEP Contractors’ Meeting — Washington, DC 
NAEP State Coordinator Orientation — Rockville, MD 
Writing Scoring — Virginia Beach, VA 



May 2-3 
May 3-4 
May 7-8 
May 8-9 
May 9 

May 16-18 
May 28-30 



May 



Panel 1 — Geography Anchor Meeting — Princeton, NJ 
Design and Analysis Committee (DAC) Meeting — Princeton, NJ 
Reading Committee Meeting — Princeton, NJ 
NAEP State Coordinator Orientation — Washington, DC 
Release of The Nation's Report Cards: U.S. Histoiy Highlight 2001 
(NOES 2002-482) and U.S. History 2001 (NOES 2002-483) 

National Assessment Governing Board (NAGB) Meeting — Washington, DC 
Foreign Language Committee Meeting — Washington, DC 



June 9-10 
June 12-14 
June 19-21 
June 20 



June 



NAEP State Coordinator Orientation — Washington, DC 
Panel 2 — Geography Anchor Meeting — Princeton, NJ 
Mathematics Bilingual Committee Meeting — Princeton, NJ 
Release of The Nation’s Report Cards: Geography 2001 (NOES 2002-484) 
and Geography Highlights 2001 (NCES 2002-485) 




DCOTr'rMTV/ A\ /A II ADI CT 










NAEP 2002 

MEETINGS AND 
PUBLICATIONS 
RELEASE DATES 



Assessment Cycle October 1, 2001 - September 30, 2002 




July 1-2 
July 1-2 
July 22-24 
July 23-26 



Mathematics Committee Meeting — Princeton, NJ 

Reading Committee Meeting — Princeton, NJ 

NAEP State Coordinator “Large Group” Training — Washington, DC 

New NAEP Coordinators Orientation and 

NAEP Network Item Review for Math and Reading — Washington, DC 



August 1-3 
August 8 
August 20-21 
August 22-25 
August 27 



August 



National Assessment Governing Board (NAGB) Meeting — Washington, DC 

NAEP Contractors’ Meeting — Washington, DC 

NAEP State Coordinator Orientation — Washington, DC 

NAEP State Coordinator “Large Group” Training — Washington, DC 

NAEP Validity Studies Panel (NVS) Meeting — Washington, DC 



September 



September 19-20 Mathematics Committee Meeting — Princeton, NJ 

September 16-17 NAEP State Coordinator Orientation — Alexandria, VA 

September 18-20 NAEP State Coordinator Workshop on Building Relations with Schools 

and Districts — Washington, DC 



NAEP State Coordinator Training 

Orientation sessions with 36 NAEP State Coordinators intro- 
duced NAEP and their responsibilities in the program. Topics 
included the role of the NAEP State Coordinator in NAEP and 
in the Coordinator's own State, team building to get the job 
done, and NAEP resources. Large Group training sessions with 
31 NAEP State Coordinators extended the orientation sessions, 
and focused on the dissemination plan each coordinator need- 
ed to create and submit to NCES. Topics in these sessions 
included Title I requirements, building teams with districts and 
schools, NAEP sampling, 2003 NAEP activities, developing the 
dissemination and outreach plan, and working with the NAEP 
coaches. A third program attended by 11 NAEP State 



Coordinators combined orientation and large group training 
and gave comprehensive coverage to all the training topics; 
some topics were covered by means of an internet WebEx 
hookup. A workshop attended by 40 coordinators focused 
on the Coordinator's role in recruiting schools for the NAEP 
sample, and included a panel discussion by previous 
NAEP Coordinators. 

A total of 8 NAEP State Coordinator orientation and training 
sessions were held in the Washington, DC area between April 
and September, 2002. Also, the workshop entitled “Building 
Relations with Schools and Districts" was held in Washington, 
DC, in September. 
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NAEP 2002 



NAEP CONTRACTORS |] 
FOR 2003-2009 1 



Assessment Cycle October 1, 2001 - September 30, 2002 

NCES has organized its work on NAEP and increased its capacity 
for getting the job done by adding the nnanpower and expertise of 
several contractors. 



Alliance Coordination 

Ensures coordination among Alliance contractors; 
maintains data for tracking program progress; and 
provides logistical support for written complaints. 

Design, Analysis, and Reporting (DAR) 

Designs all pilot and field tests, operational assess- 
ments and special studies; analyzes data to ensure 
the reporting of valid results; proposes and 
studies psychometric and statistical analyses 
compatible with previous NAEP methodologies; 
determines the data needed to meet the goals for 
reporting; and prepares reports. 

Item Development 

Develops the background variables, cognitive items, 
and scoring rubrics; assists in scoring and the 
training of scorers; conducts small-scale pilot tests 
of the items and rubrics; and participates in reviews 
of items. 

Material Preparation 

Prepares and packages the assessment and all 
auxiliary materials; distributes assessment booklets 
and materials to the test administrators for each 
school; develops training and scoring materials; and 
scores all assessments. 

Sampling and Data Collection 

Selects representative samples; prepares sample 
weights for NAEP assessments; administers assess- 
ments and collects data from field tests, operational 
assessments, and special studies; and ships com- 
pleted assessment materials to the scoring sites. 

Web Operations and Maintenance (WOM) 

Acquires, develops, implements, and supports 
Internet-related applications and services for NAEP 
and the NAEP contractors; identifies and deploys 
emerging technologies and new products to improve 
NAEP's offerings; and ensures timely services and 
release of quality products using web technologies. 



Dissemination & Outreach 

Designs all NAEP products; designs and produces a 
portable convention booth to display materials; cre- 
ates dissemination plans for NAEP reports, special 
studies and secondary analysis grants. 

NAEP State Coordinators (NSC) 

Serves as the liaison between the State Education 
Agency and the National Assessment of Educational 
Progress (NAEP); serves as the state’s representa- 
tive to review NAEP assessment items and process- 
es; coordinates the NAEP administration in the 
state; analyzes and reports NAEP data; and coordi- 
nates the use of NAEP results for policy and pro- 
gram planning. 

Meeting Logistics (ML) 

Provides support to NAEP and NAEP contractors by 
planning meetings, staffing meetings, arranging 
travel, and related activities for meetings. 

NAEP Quality Assurance (QA) 

Assures the integrity of NAEP assessments and the 
assessment process through ongoing monitoring 
and identification of potential technical and opera- 
tional errors. 

state Service Center (SSC) — To Be Awarded 

Establishes a NAEP State Service Center to provide 
ongoing support, technical assistance and training 
for the NAEP State Coordinators; answers informa- 
tion requests regarding NAEP; and maintains a 
NAEP Information Center. 

state Analysis (SA) — To Be Awarded 

Enhances NAEP’s capability to monitor academic 
progress and the performance trends of states and 
their identified subgroups; portrays patterns of 
achievement gaps between the subgroups on NAEP 
state assessments; explains NAEP state results; and 
identifies patterns of performance that could affect 
NAEP assessments in states/jurisdictions. 
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Assessment Cycle October 1, 2001 - September 30, 2002 



WEB SITE FACTS 
AND FIGURES 



Join the thousands who have visited the NAEP web site 
to access the many NAEP publications, data files, and 
released items available there. 



http://nces.ed.gov/nationsreportcard 



Monthly Visits 
to NAEP Web Site 
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Chronicle of NAEP Web 
Site Usage 


Year and Month 


Average Number High Number of Users 
of Users Per Day for Month (date) 


2001 

October 


957 


1,342 (10/16) 


November 


1,402 


6,158 (11/20) 


December 


714 


1.718 (12A)3) 


2002 


January 


943 


1,441 (01/30) 


February 


1,120 


1,541 (02/05) 


March 


1,011 


1,445 (03/05) 


April 


1,000 


1,446 (04/22) 


May 


2,028 


15,211 (05/10) 


June 


1,098 


3,553 (06/21) 


July 


904 


1,314 (07/09) 


August 


845 


1,275 (08/28) 


September 


U04 


1.456 (09/04) 
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